(19) 




(12) 



Europafsches Patentamt 
European Patent Office 
Office europeen des brevets 



01) 



EP 0 903 726 A2 



EUROPEAN PATENT APPLICATION 



(43) 


Date of publication: 


(51) int ciA G10K 11/178 




24.03.1999 Bulletin 1999/12 


(21) 


Application number: 98307273.7 




(22) 


Date of filing: 09.09.1998 




(84) 


Designated Contracting States: 


(72) Inventors: 




AT BE CH CY DE DK ES Fl FR GB GR IE IT LI LU 


• Finn, Brian M. 




MC NL PT SE 


Madison, Wisconsin 537915 (US) 




Designated Extension States: 


• Roe, Thomas O. 




AL LT LV MK RO SI 


Stoughton, Wisconsin 53589 (US) 


(30) 


Priority: 11.09.1997 US 927874 


(74) Representative: Burke, Steven David et a I 






R.G.C. Jenkins & Co. 


(71) 


Applicant: Digisonix, Inc. 


26 Caxton Street 




Middleton, Wisconsin 53562-2543 (US) 


London SW1H0RJ (GB) 



(54) Active acoustic noise and echo cancellation system 



< 

CO 
CM 
h- 

CO 
O 
O 

o 

CL 
LLI 



(57) Full acoustic coupling and echo cancellation is 
provided in implementations where there is acoustic 
coupling between acoustic zones. In acoustic echo can- 
cellation systems, including active acoustic attenuation 
systems and communications systems, having a first 
model canceling the speech of a second person in the 
output of a first microphone otherwise present due to 
electrical transmission from a second microphone to a 
first loudspeaker and broadcast by the first loudspeaker 
to the first microphone, the cancellation of the speech 
of the second person in the output of the first micro- 
phone preventing rebroadcast thereof by the second 
loudspeaker, and a second model canceling the speech 
of the first person in the output of the second micro- 
phone otherwise present due to electrical transmission 



from the first microphone to the second loudspeaker and 
broadcast by the second loudspeaker to the second mi- 
crophone, the cancellation of the speech of the first per- 
son in the output of the second microphone preventing 
rebroadcast thereof by the first loudspeaker, an im- 
provement provides a third model cancelling the speech 
of the first person in the output of the first microphone 
otherwise present due to acoustic transmission from the 
second loudspeaker in the second zone to the first mi- 
crophone in the first zone, and a fourth model cancelling 
the speech of the second person in the output of the 
second microphone otherwise due to acoustic transmis- 
sion from the first loudspeaker in the first zone to the 
second microphone in the second zone. Further im- 
provements and features are provided in various com- 
binations. 
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Description 

[0001] The invention relates to acoustic echo cancel- 
lation systems, including active acoustic attenuation 
systems and communication systems. The invention s 
arose during continuing development efforts relating to 
the subject matter of U.S. Patent 5,033,082, incorporat- 
ed herein by reference. 

[0002] In one aspect of the invention, a fully coupled 
active echo cancellation matrix is provided, canceling 
echo due to acoustic transmission between zones, in 
addition to cancellation of echoes due to electrical trans- 
mission between zones as in incorporated U.S. Patent 
5,033,082. In the latter patent, a communication system 
is provided including a first acoustic zone, a second 
acoustic zone, a first microphone at the first zone, a first 
loudspeaker at the first zone, a second microphone at 
the second zone and having an output supplied to the 
first loudspeaker such that a first person at the first zone 
can hear the speech of a second person at the second 
zone as transmitted by the second microphone and the 
first loudspeaker, a second loudspeaker at the second 
zone and having an input supplied from the first micro- 
phone such that the second person at the second zone 
can hear the speech of the first person at the first zone 
as transmitted by the first microphone and the second 
loudspeaker, a first model cancelling the speech of the 
second person in the output of the first microphone oth- 
erwise present due to electrical transmission from the 
second microphone to the first loudspeaker and broad- 
cast by the first loudspeaker to the first microphone, the 
cancellation of the speech of the second person in the 
output of the first microphone preventing rebroadcast 
thereof by the second loudspeaker, and a second model 
cancelling the speech of the first person in the output of 
the second microphone otherwise present due to elec- 
trical transmission from the first microphone to the sec- 
ond loudspeaker and broadcast by the second loud- 
speaker to the second microphone, the cancellation of 
the speech of the first person in the output of the second 
microphone preventing rebroadcast thereof by the first 
loudspeaker. In the present invention, there is provided 
a third model cancelling the speech of the first person 
in the output of the first microphone otherwise present 
due to acoustic transmission from the second loud- 
speaker in the second zone to the first microphone in 
the first zone, and a fourth model canceling the speech 
of the second person in the output of the second micro- 
phone otherwise due to acoustic transmission from the 
first loudspeaker in the first zone to the second micro- 
phone in the second zone. The present invention has 
desirable application in those implementations where 
there is acoustic coupling between the first and second 
zones, for example in a vehicle such as a minivan, 
where the first zone is the front seat and the second 
zone is a rear seat, and it is desired to provide an inter- 
com communication system, and cancel echoes not on- 
ly due to local acoustic transmission in a zone but also 



global acoustic transmission between zones, including 
in combination with active acoustic attenuation. 
[0003] In another aspect of the invention, there is pro- 
vided a switch having open and closed states, and con- 
ducting the output of a microphone therethrough in the 
closed state, a voice activity detector having an input 
from the output of the microphone at a node between 
the microphone and the switch, an occupant sensor 
sensing the presence of a person at the acoustic zone, 
and a logical AND function having a first input from the 
voice activity detector, a second input from the occupant 
sensor, and an output to the switch to actuate the latter 
between open and closed states. This feature is desir- 
able in automotive applications when there are no addi- 
tional passengers for a driver to communicate with. 
[0004] In another aspect of the invention, an input to 
a model is supplied through a variable training signal 
circuit providing increasing training signal levels with in- 
creasing speech signal levels or increased interior am- 
bient noise levels associated with higher vehicle 
speeds. This is desirable for on-line training noise to be 
imperceptible by the occupant yet have a sufficient sig- 
nal to noise ratio for accurate model convergence. 
[0005] In another aspect of the invention, a noise re- 
sponsive high pass filter is provided between a micro- 
phone and a remote yet acoustically coupled loud- 
speaker, and having a filter cutoff effective at elevated 
noise levels and reducing bandwidth and making more 
gain available, to improve intelligibility of speech of a 
person in the zone of the microphone transmitted to the 
remote loudspeaker. In vehicle applications, the high 
pass filter is vehicle speed sensitive, such that at higher 
vehicle speeds and resulting higher noise levels, lower 
frequency speech content is blocked and higher fre- 
quency speech content is passed, the lower frequency 
speech content being otherwise masked at higher 
speeds by broadband vehicle and wind noise, so that 
the reduced bandwidth and the absence of the lower fre- 
quency speech content does not sacrifice the perceived 
quality of speech, and such that at lower vehicle speeds 
and resulting lower noise levels, the cutoff frequency of 
the filter is lowered such that lower frequency speech 
content is passed, in addition to higher frequency 
speech content, to provide enriched low frequency per- 
formance, and overcome objections to a tinny sounding 
system. 

[0006] In another aspect, there is provided a feedback 
detector having an input from a microphone, and an out- 
put controlling an adjustable notch filter filtering the out- 
put of the microphone supplied to a remote yet acous- 
tically coupled loudspeaker. This overcomes prior ob- 
jections in closed loop communication systems which 
can become unstable whenever the total loop gain ex- 
ceeds unity. Careful setting of system gain and acoustic 
echo cancellation may be used to ensure system stabil- 
ity. For various reasons, such as high gain require- 
ments, acoustic feedback may occur, which is often at 
the system resonance or where the free response is rel- 
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ativety undamped. These resonances usually have a 
very high Q factor and can be represented by a narrow 
band in the frequency domain. Thus, the total system 
gain ceiling is determined by a small portion of the com- 
munication system bandwidth, in essence limiting per- 
formance across all frequencies in the band for one or 
more narrow regions. The present invention overcomes 
this objection. 

[0007] In another aspect of the invention, an acoustic 
feedback tonal canceler is provided, removing tonal 
noise from the output of the microphone to prevent 
broadcast thereof by a remote but acoustically coupled 
loudspeaker. 

[0008] Other features and aspects are provided, as 
will be understood in the following description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0009] Fig. 1 shows an active acoustic attenuation 
and communication system in accordance with the in- 
vention. 

[0010] Fig. 2 shows an intercom communication sys- 
tem in accordance with the invention. 
[0011] Fig. 3 shows a portion of a communication sys- 
tem in accordance with the invention. 
[0012] Fig. 4 shows a communication system in ac- 
cordance with the invention. 

[001 3] Fig. 5 shows a communication system in ac- 
cordance with the invention. 

[0014] Fig. 6 shows a communication system in ac- 
cordance with the invention. 

[0015] Fig. 7 shows a communication system in ac- 
cordance with the invention. 

[0016] Fig. 8 shows a communication system in ac- 
cordance with the invention. 

DETAILED DESCRIPTION 

Prior Art 

[0017] Fig. 1 is simitar to the drawing of incorporated 
U.S. Patent 5,033,082, and uses like reference numer- 
als where appropriate to facilitate understanding. Fig. 1 
shows an active acoustic attenuation system 10 having 
a first zone 12 subject to noise from a noise source 14, 
and a second zone 1 6 spaced from zone 1 2 and subject 
to noise from a noise source 18. Microphone 20 senses 
noise from noise source 14. Microphone 22 senses 
noise from noise source 18. Zone 12 includes a talking 
location 24 therein such that a person 26 at location 24 
is subject to noise from noise source 14. Zone 16 in- 
cludes a talking location 28 therein such that a person 
30 at location 28 is subject to noise from noise source 
18. Loudspeaker 32 introduces sound into zone 12 at 
location 24. Loudspeaker 34 introduces sound into zone 
16 at location 28. An error microphone 36 senses noise 
and speech at location 24. Error microphone 38 senses 
noise and speech at location 28. 



[0018] An adaptive filter model 40 adaptivety models 
the acoustic path from noise microphone 20 to talking 
location 24. Model 40 is preferably that disclosed in U. 
S. Patent 4,677,676, incorporated herein by reference. 

s Adaptive filter model 40 has a model input 42 from noise 
microphone 20, an error input 44 from error microphone 
36, and outputs at output 46 a correction signal to loud- 
speaker 32 to introduce cancelling sound at location 24 
to cancel noise from noise source 14 at location 24, all 

10 as in incorporated U.S. Patent 4,677,676. 

[0019] An adaptive filter model 48 adaptivety models 
the acoustic path from noise microphone 22 to talking 
location 28. Model 48 has a model input 50 from noise 
microphone 22, an error input 52 from error microphone 

15 38, and outputs at output 54 a correction signal to loud- 
speaker 34 to introduce cancelling sound at location 28 
to cancel noise from noise source 18 at location 28. 
[0020] An adaptive filter model 56 adaptiveiy cancels 
noise from noise source 1 4 in the output 58 of error mi- 

20 crophone 36. Model 56 has a model input 60 from noise 
microphone 20, an output correction signal at output 62 
subtractively summed at summer 64 with the output 58 
of error microphone 36 to provide a sum 66, and an error 
input 68 from sum 66. 

25 [0021] An adaptive filter model 70 adaptiveiy cancels 
noise from noise source 1 8 in the output 72 of error mi- 
crophone 38. Model 70 has a model input 74 from noise 
microphone 22, an output correction signal at output 76 
subtractively summed at summer 78 with the output 72 

30 of error microphone 38 to provide a sum 80, and an error 
input 82 from sum 80. 

[0022] An adaptive filter model 84 adaptiveiy cancels 
speech from person 30 in the output 58 of error micro- 
phone 36. Model 84 has a model input 86 from error 

35 microphone 38, an output correction signal at output 88 
subtractively summed at summer 90 with sum 66 to pro- 
vide a sum 92, and an error input 94 from sum 92. Sum 
92 is additiveiy summed at summer 96 with the output 
54 of model 48 to provide a sum 98 which is supplied to 

40 loudspeaker 34. Sum 92 is thus supplied to loudspeaker 
34 such that person 30 can hear the speech of person 
26. 

[0023] An adaptive filter model 100 adaptiveiy can- 
cels speech from person 26 in the output 72 of error mi- 

^5 crophone 38. Model 100 has a model input 102 from 
error microphone 36 at sum 92, an output correction sig- 
nal at output 104 subtractively summed at summer 106 
with sum 80 to provide a sum 108, and an error input 
110 from sum 108. Sum 108 is additiveiy summed at 

50 summer 112 with the output 46 of model 40 to provide 
a sum 1 1 4 which is supplied to loudspeaker 32. Hence, 
sum 108 is supplied to loudspeaker 32 such that person 
26 can hear the speech of person 30. Model input 86 is 
provided by sum 108, and model input 102 is provided 

55 by sum 92. 

[0024] Sum 98 supplied to loudspeaker 34 is substan- 
tially free of noise from noise source 14 as acoustically 
and electrically cancelled by adaptive filter models 40 
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and 56, respectively. Sum 98 is substantially free of 
speech from person 30 as electrically cancelled by 
adaptive fitter model 84. Hence, sum 93 to loudspeaker 
34 is substantially free of noise from noise source 14 
and speech from person 30 but does contain speech $ 
from person 26, such that loudspeaker 34 cancels noise 
from noise source 18 at location 28 and introduces sub- 
stantially no noise from noise source 14 and introduces 
substantially no speech from person 30 and does intro- 
duce speech from person 26, such that person 30 can 10 
hear person 26 substantially free of noise from noise 
sources 14 and 18 and substantially free of his own 
speech. 

[0025] Sum 114 supplied to loudspeaker 32 is sub- 
stantially free of noise from noise source 18 as acous- is 
tically and electrically cancelled by adaptive filter mod- 
els 48 and 70, respectively Sum 1 1 4 is substantially free 
of speech from person 26 as electrically cancelled by 
adaptive filter model 100. Sum 114 to loudspeaker 32 is 
thus substantially free of noise from noise source 1 8 but 20 
does contain speech from person 30, such that loud- 
speaker 32 cancels noise from noise source 14 at loca- 
tion 24 and introduces substantially no noise from noise 
source 18 and introduces substantially no speech from 
person 26 and does introduce speech from person 30, 2$ 
such that person 26 can hear person 30 substantially 
free of noise from noise sources 1 4 and 1 8 and substan- 
tially free of his own speech. 

[0026] Each of the adaptive filter models is preferably 
that shown in above incorporated U.S. Patent 30 
4,677,676. Each model adaptively models its respective 
forward path from its respective input to its respective 
output on-line without dedicated off-line pretraining. 
Each of models 40 and 48 also adaptively models its 
respective feedback path from its respective loudspeak- 35 
er to its respective microphone for both broadband and 
narrowband noise without dedicated off-line pretraining 
and without a separate model dedicated solely to the 
feedback path and pretrained thereto. Each of models 
40 and 48, as in above noted incorporated U.S. Patent *o 
4,677,676, adaptively models the feedback path from 
the respective loudspeaker to the respective micro- 
phone as part of the adaptive filter model itself without 
a separate model dedicated solely to the feedback path 
and pretrained thereto. Each of models 40 and 48 has *s 
a transfer function comprising both zeros and poles to 
model the forward path and the feedback path, respec- 
tively. Each of models 56 and 70 has a transfer function 
comprising both poles and zeros to adaptively model the 
pole-zero acoustical transfer function between its re- so 
spective input microphone and its respective error mi- 
crophone. Each of models 84 and 100 has a transfer 
function comprising both poles and zeros to adaptively 
model the pole-zero acoustical transfer function be- 
tween its respective output loudspeaker and its respec- 55 
tive error microphone. The adaptive filter for all models 
is preferably accomplished by the use of a recursive 
least mean square filter, as described in incorporated U. 



S. Patent 4,677,676. It is also preferred that each ol the 
models 40 and 48 be provided with an auxiliary noise 
source, such as 140 in incorporated U.S. Patent 
4,677,676, introducing auxiliary noise into the respec- 
tive adaptive filter model which is random and uncorre- 
cted with the noise from the respective noise source to 
be cancelled. 

[0027] In one embodiment, noise microphones 20 
and 22 are placed at the end of a probe tube in order to 
avoid placing the microphones directly in a severe en- 
vironment such as a region of high temperature or high 
electromagnetic field strength. Alternatively, the signals 
produced by noise microphones 20 and 22 are obtained 
from a vibration sensor placed on the respective noise 
source or obtained from an electrical signal directly as- 
sociated with the respective noise source, for example 
a tachometer signal on a machine or a computer gen- 
erated drive signal on a device such as a magnetic res- 
onance scanner. 

[0028] In one embodiment, a single noise source 14 
and model 40 are provided, with cancellation via loud- 
speaker 32 and communication from person 26 via mi- 
crophone 36. In another embodiment, only models 40 
and 56 are provided. In another embodiment, only mod- 
els 40, 56 and 84 are provided. 
[0029] It is thus seen that communication system 10 
includes a first acoustic zone 12, a second acoustic 
zone 16, a first microphone 36 at the first zone, a first 
loudspeaker 32 at the first zone, a second microphone 
38 at the second zone and having an output supplied to 
first loudspeaker 32 such that a first person 26 at first 
zone 1 2 can hear the speech of a second person 30 at 
second zone 16 as transmitted by second microphone 
38 and first loudspeaker 32, and a second loudspeaker 
34 at second zone 16 and having an input supplied from 
first microphone 36 such that the second person 30 at 
the second zone 1 6 can hear the speech of the first per- 
son 26 at the first zone 12 as transmitted by first micro- 
phone 36 and second loudspeaker 34. Each of the 
zones is subject to noise. First person 26 at first talking 
location 24 in first zone 1 2 and second person 30 at sec- 
ond talking location 28 in second zone 16 are each sub- 
ject to noise. Loudspeaker 32 introduces sound into first 
zone 12 at first talking location 24. Loudspeaker 34 in- 
troduces sound into second zone 1 6 at second talking 
location 28. Error microphone 36 senses noise and 
speech at location 24. Model 40 has a model input from 
a reference signal correlated to the noise as provided 
by input microphone 20 sensing noise from noise source 
1 4. Model 40 has an error input 44 from microphone 36. 
Model 40 has a model output 46 outputting a correction 
signal to loudspeaker 32 to introduce canceling sound 
at location 24 to attenuate noise thereat. Error micro- 
phone 38 senses noise and speech at location 28. Mod- 
el 48 has a model input 50 from a reference signal cor- 
related with the noise as provided by input microphone 
22 sensing the noise from noise source 18. Model 48 
has an error input 52 from microphone 38. Model 48 has 
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a model output 54 outputting a correction signal to loud- 
speaker 34 to introduce cancelling sound at location 28 
to attenuate noise thereat. Model 56 has a model input 
60 from microphone 20, a model output 62 outputting a 
correction signal summed at summer 64 with the output 
58 of microphone 36 to electrically cancel noise from 
first zone 1 2 in the output of microphone 36, and an error 
input 68 from the output 66 of summer 64. Model 70 has 
a model input 74 from microphone 22, a model output 
76 outputting a correction signal summed at summer 78 
with the output 72 of microphone 38 to cancel noise from 
zone 16 in the output of microphone 38, and an error 
input 82 from the output 80 of summer 78. Model 84 can- 
cels the speech of second person 30 in the output of 
microphone 36 otherwise present due to electrical trans- 
mission from microphone 38 to loudspeaker 32 and 
broadcast by loudspeaker 32 to microphone 36, the can- 
cellation of the speech of person 30 in the output of mi- 
crophone 36 preventing rebroadcast thereof by loud- 
speaker 34. Model 1 00 cancels the speech of person 26 
in the output of microphone 38 otherwise present due 
to electrical transmission from microphone 36 to loud- 
speaker 34 and broadcast by loudspeaker 34 to micro- 
phone 38, the cancellation of the speech of person 26 
in the output of microphone 34 preventing rebroadcast 
thereof by loudspeaker 32. 

[0030] The system above described is shown in incor- 
porated U.S. Patent 5,033,082. 

Present Invention 

[0031 ] I n the present invention, additional models 1 20 
and 1 22 are provided. Model 1 20 cancels the speech of 
person 26 in the output of microphone 36 otherwise 
present due to acoustic transmission from loudspeaker 
34 in zone 16 to microphone 36 in zone 12. This is de- 
sirable in implementations where there is no acoustic 
isolation or barrier between zones 12 and 16, for exam- 
ple as in a vehicle such as a minivan where zone 12 
may be the front seat and zone 1 6 a back seat, i.e. where 
there is acoustic coupling of the zones and acoustic 
transmission therebetween such that sound broadcast 
by loudspeaker 34 is not only electrically transmitted via 
microphone 38 and loudspeaker 32 to zone 12, but is 
also acoustically transmitted from loudspeaker 34 to 
zone 12. Model 122 cancels the speech of person 30 in 
the output of microphone 38 otherwise due to acoustic 
transmission from loudspeaker 32 in zone 1 2 to micro- 
phone 38 in zone 16. 

[0032] Model 84 models the path from loudspeaker 
32 to microphone 36. Model 100 models the path from 
loudspeaker 34 to microphone 38. Model 1 20 models 
the path from loudspeaker 34 to microphone 36. Model 
122 models the path from loudspeaker 32 to micro- 
phone 38. Model 84 has a model input 86 from the input 
to loudspeaker 32 supplied from the output of micro- 
phone 38, and a model output 88 to the output of micro- 
phone 36 supplied to the input of loudspeaker 34. Model 



1 0X) has a model input 1 02 from the input to loudspeaker 
34 supplied from the output of microphone 36, and a 
model output 104 to the output of microphone 38 sup- 
plied to the input of loudspeaker 32. Model 120 has a 
5 model input 124 from the input to loudspeaker 34 sup- 
plied from the output of microphone 36, and a model 
output 126 to the output of microphone 36 supplied to 
the input of loudspeaker 34. Model 122 has a model in- 
put 128 from the input to loudspeaker 32 supplied from 

io the output of microphone 38, and a model output 1 30 to 
the output of microphone 38 supplied to the input of 
loudspeaker 32. An auxiliary noise source 1 32, like aux- 
iliary noise source 140 in incorporated U.S. Patent 
4,677,676, introduces auxiliary noise through summer 

15 134 into model inputs 102 and 124 of models 100 and 
120, respectively, which auxiliary noise is random and 
uncorrelated with the noise from the respective noise 
source to be canceled. In one embodiment, the auxiliary 
noise source 132 is provided by a Galois sequence, M. 

20 R. Schroeder, Number Theory In Science And Commu- 
nications, Berlin: Springer- Vertag, 1984, pages 
252-261, though other random uncorrelated noise 
sources may of course be used. The Galois sequence 
is a pseudo random sequence that repeats after 2 M -1 

25 points, where M is the number of stages in a shift reg- 
ister. The Galois sequence is preferred because it is 
easy to calculate and can easily have a period much 
longer than the response time of the system. An auxil- 
iary random noise source 1 36 introduces auxiliary noise 

30 through summer 138 into model inputs 86 and 128 of 
models 84 and 122, respectively, which auxiliary noise 
is random and uncorrelated with the noise from the re- 
spective noise source to be canceled. It is preferred that 
auxiliary noise source 136 be provided by a Galois se- 

35 quence, as above described. Each of auxiliary noise 
sources 1 32 and 1 36 is random and uncorrelated rela- 
tive to each other and relative to noise from noise source 
14, speech from person 26, noise from noise source 18, 
and speech from person 30. Model 1 20 is trained to con- 

*o verge to and model the path from loudspeaker 34 to mi- 
crophone 36 by the auxiliary noise from source 132. 
Model 100 is trained to converge to and model the path 
from loudspeaker 34 to microphone 38 by the auxiliary 
noise from source 132. Model 84 is trained to converge 

45 to and model the path from loudspeaker 32 to micro- 
phone 36 by the auxiliary noise from source 1 36. Model 
122 is trained to converge to and model the path from 
loudspeaker 32 to microphone 38 by the auxiliary noise 
from source 1 36. 

50 [0033] Fig. 2 shows a system similar to Fig. 1, and 
uses like reference numerals where appropriate to fa- 
cilitate understanding. The system of Fig. 2 is used in a 
vehicle 140, such as a minivan. Loudspeaker 32 pro- 
vides enhanced voice from zone 2, i.e. with noise and 

55 echo cancellation as above described. Loudspeaker 32 
also provides audio for zone 1 and cellular phone for 
zone 1 at 12 such as the front seat. Also supplied at 
zone 1 are voice in zone 1 from person 26 such as the 
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driver and/or front seat passenger Also supplied at zone 
1 due to acoustic coupling from zone 2 are the echo of 
enhanced voice 1 broadcast by speaker 34, with noise 
and echo cancellation as above described, and audio 
from zone 2 and cellular phone from zone 2. The signal 
content in the output 58 of microphone 36 as shown at 
59 includes: voice 1; enhanced voice 1 echo; enhanced 
voice 2; audio 1; audio 2; cell phone 1; cell phone 2. 
Loudspeaker 34 broadcasts enhanced voice 1. audio for 
zone 2 and cellular phone for zone 2 at 16 such as a 
rear seat of the vehicle. Also supplied at zone 2 are voice 
in zone 2 from person 30, such as one or more rear seat 
passengers, enhanced voice 2 echo which is the voice 
from zone 2 as broadcast by speaker 32 in zone 1 due 
to acoustic coupling therebetween, as well as audio 
from zone 1 and cell phone from zone 1 as broadcast 
by speaker 32. The signal content in the output 72 of 
microphone 38 as shown at 73 includes: voice 2; en- 
hanced voice 2 echo; enhanced voice 1 ; audio 1 ; audio 
2; cell phone 1; cell phone 2. Summer 90 sums the out- 
put 58 of microphone 36, the output 88 of model 84, and 
the output 1 26 of model 1 20, and supplies the resultant 
sum at 92 to summer 1 34, error correlator multiplier 1 42 
of model 84, and error correlator multiplier 144 of model 
120. Summer 134 sums the output 92 of summer 90, 
the training signal from auxiliary random noise source 
1 32, and the audio 2 and cell phone 2 signals for zone 
2, and supplies the resultant sum to loudspeaker 34, 
model input 124 of model 120, and model input 102 of 
model 100. Summer 106 sums the output 72 of micro- 
phone 38, model output 104 ol model 100, and model 
output 1 30 of model 1 22, and supplies the resultant sum 
at 108 to summer 1 38, error correlator multiplier 146 of 
model 100, and error correlator multiplier 148 of model 
1 22. Summer 1 38 sums the output 1 08 of summer 1 06, 
the training signal from auxiliary random noise source 
136, and the audio 1 and cell phone 1 signals for zone 
1, and supplies the resultant sum to loudspeaker 32, 
model input 86 of model 84, and model input 1 28 of mod- 
el 1 22. The training signal from auxiliary random noise 
source 1 32 is supplied to summer 1 34 and to error cor- 
relator multipliers 146 and 144 of models 100 and 120, 
respectively. The training signal from auxiliary random 
noise source 1 36 is supplied to summer 1 38 and to error 
correlator multipliers 1 42 and 1 48 of models 84 and 1 22, 
respectively. 

[0034] In digital voice enhancement, DVE, systems, 
acoustic echo cancelers, AEC, are used to minimize 
acoustic reflection and echo, prevent acoustic feed- 
back, and remove additional unwanted signals. Acous- 
tic echo cancelers are most often only applied between 
the immediate zone loudspeaker and microphone, e.g. 
model 84 modeling the path from loudspeaker 32 to mi- 
crophone 36. However, in certain applications where the 
propagation losses or physical damping between com- 
munication zones such as 1 2 and 1 6 is not sufficient, e. 
g. a vehicle interior such as a minivan, the acoustic path 
between these zones may allow significant coupling and 



cause added system echo, acoustic feedback and sig- 
nal corruption. 

[0035] The present invention applies acoustic echo 
cancelers between all microphones and loudspeakers 
5 in the digital voice enhancement system as shown in 
Fig. 2. This allows signal contributions from the following 
sources to be removed from the microphone signal so 
that it includes only the voice signal from the near end 
talker: the far end voice broadcast from the near end 
io loudspeaker; the near end audio broadcast from the 
near end loudspeaker; the near end voice broadcast 
from the far end loudspeaker; the far end audio broad- 
cast from the far end loudspeaker; cellular phone broad- 
cast from near end and far end loudspeakers. By remov- 
es ing these components, the closed loop full duplex com- 
munication system is more stable with desired system 
gains that were not previously possible. In addition, the 
resulting signal has less extraneous noise which allows 
enhanced precision in speech processing activities. 
20 [0036] Acoustic echo cancellation may require on-line 
estimation of the acoustic echo path. In vehicle imple- 
mentations, it is desirable to detect when occupant 
movement occurs, to as quickly as possible update the 
acoustic echo cancellation models. In a desirable fea- 
25 ture enabled by the present invention, the available sup- 
plemental restraint occupant sensor or a seat belt use 
detector may be monitored. If the sensor indicates a 
change in occupant location or seat belt use, an occu- 
pant movement is assumed, and rapid adaptation oc- 
30 curs to correct the acoustic echo cancellation models 
and ensure optimal performance of the system. 
[0037] Further in vehicle implementations, the proper 
placement of a communication microphone is difficult 
due to varying sizes of occupants and seat track loca- 
ls tions. Less ideal microphone locations result in lower 
signal to noise ratios, higher required system gain, and 
lower performance. In a desirable aspect, the present 
invention enables utilization of supplemental restraint 
occupant sensors or seat track location sensors, poten- 
40 tially available in future supplemental restraint occupant 
position detection systems. From such sensors, certain 
weight, height, fore/aft location information, etc., may be 
available. The present invention enables use of such in- 
formation to select the most appropriate microphone, e. 
4$ g. from a bank of microphones, and/or gain selection to 
ensure system performance. For example, certain 
weight or height information would signal a short occu- 
pant. From this information, the general seat track po- 
sition may be presumed or obtained from a seat track 
so location sensor, and a best suited microphone selected. 
Also, from height information, the distance from the oc- 
cupant to the selected microphone might be estimated, 
and an appropriate gain applied to account for extra dis- 
tance from the selected microphone. The present inven- 
55 tion enables utilization of such signals to increase sys- 
tem robustness by selecting appropriate transducers 
and parameters. This provides microphone selection 
and/or gain selection by occupant sensor input. 



6 



11 



EP 0 903 726 A2 



12 



[0036] Multidimensional digital voice enhancement 
systems can be reconfigured during operation to match 
occupant requirements. Many activities are processor 
intensive and compromise system robustness when 
compared with smaller dimensioned systems. In a de- 
sirable aspect, the present invention enables utilization 
of vehicle occupant sensor or seat belt use detector in- 
formation to determine if an occupant is present in a par- 
ticular digital voice enhancement zone. If an occupant 
is not detected, certain functions associated with that 
zone may be eliminated from the computational activi- 
ties. Processor ability may be reassigned to other zones 
to do more elaborate signal processing. The present in- 
vention enables the system to reconfigure its dimen- 
sionality to perform in an optimum fashion with the re- 
quirements placed on it. This provides digital voice en- 
hancement zone hibernation based on occupant sen- 
sors. 

[0039] In digital voice enhancement systems, acous- 
tic echo cancelers are used to minimize echo, stabilize 
closed loop communication channels, and prevent 
acoustic feedback, as above noted. The acoustic echo 
cancelers model the acoustic path between each loud- 
speaker and each microphone associated with the sys- 
tem. This full coupling of all the loudspeakers and mi- 
crophones may be computationally expensive and ob- 
jectionable in certain applications. In a desirable aspect, 
the present invention allows acoustic echo cancelers to 
be applied to loudspeaker-microphone acoustic paths 
when limited processor capabilities exist. Transfer func- 
tions are taken between each loudspeaker-microphone 
combination. The gain over the communication system 
bandwidth is compared between transfer functions. 
Those transfer functions exhibiting a higher gain trend 
over the frequency band indicate greater acoustic cou- 
pling between the particular loudspeaker and micro- 
phone. The system designer may use a gain trend rank- 
ing to apply acoustic echo cancelers first to those paths 
with the greater acoustic coupling. This allows the sys- 
tem designer to prioritize applying acoustic echo can- 
celers to the loudspeaker-microphone paths which most 
need assistance to ensure stable communication. Paths 
that cannot be serviced with acoustic echo cancelers 
would rely on the physical damping and propagation 
losses of the acoustic path for echo reduction, or other 
less intensive electronic means for increased stability. 
This enables digital voice enhancement optimization us- 
ing physical characteristics. 

[0040] A voice activity detection algorithm is judged 
by how accurately it responds to a wide variety of acous- 
tic events. One that provides a 100% hit rate on desired 
voice signals and a 0% falsing rate on unwanted noises 
is considered ideal. Use of an occupant sensing device 
as one of the inputs to the voice activity detection algo- 
rithm can provide certainty, within limits of the occupant 
sensing device, that no falsing will occur when a location 
is not occupied. This feature would be especially rele- 
vant to automotive applications when there are no ad- 



ditional passengers for a driver to communicate with. 
Smart airbags and other passive safety devices may 
soon be required to know attributes such as the size, 
shape, and presence of passengers in vehicles for prop- 
5 er deployment. The minimum desired information to be 
known at the time of deployment would be to know if 
there is a passenger to be protected. No passenger, or 
possibly more important, a small passenger or child seat 
would require disarming of the passive restraint system. 

10 This sensing information would be useful as a com- 
pounding condition in digital voice enhancement sys- 
tems to also deactivate a voice sensing microphone 
when no occupant is present. This provides voice activ- 
ity detection with occupant sensing devices. 

is [0041] Fig. 3 shows a switch 150 having open and 
closed states, and conducting the output of microphone 
38 therethrough in the closed state. A voice activity de- 
tector 152 has an input from the output of microphone 
38 at a node 154 between microphone 38 and switch 

20 1 50. An occupant sensor 1 56 senses the presence of a 
person at acoustic zone 16, for example a rear passen- 
ger seat. A logic AND function provided by AND gate 
1 58 has a first input 1 60 from voice activity detector 1 52, 
a second input 162 from occupant sensor 156, and an 

2S output 164 to switch 150 to actuate the latter between 
the open and closed states, to control whether the latter 
passes a zone transmit out signal or not. 
[0042] It is desirable for on-line training noise to be 
imperceptible by the occupant, yet have sufficient signal 

30 to noise ratio for accurate model convergence. In a de- 
sirable aspect, the present system may be used to ex- 
ploit microphone gate activity to increase the allowable 
training signal and acoustic echo cancellation conver- 
gence. This allows the acoustic echo cancellation mod- 

35 els to be more aggressively and accurately adapted. 
When the microphone gate is opened, some level of 
speech will be present. When speech is transmitted, a 
higher level training signal may be added to the speech 
signal and still be imperceptible to the occupant. This 
can be accomplished by a gate controlled training signal 
gain, Fig. 4. The present invention enables utilization of 
pre-existing system features to increase overall robust- 
ness in an unobtrusive fashion. This provides acoustic 
echo cancellation training noise level based on micro- 
ns phone gate activity. 

[0043] In Fig. 4, the input to model 84 is supplied 
through a variable training signal circuit 170 providing 
increased training signal level with increasing speech 
signal levels from microphone 38. Training signal circuit 

50 170 includes a summer 172 having an input 174 from 
microphone 38, an input 176 from a training signal, and 
an output 1 78 to loudspeaker 32 and to model 84. A var- 
iable gain element 180 supplies the training signal from 
training signal source 182 to input 176 of summer 172. 

55 a voice activity detector gate 184 senses the speech 
signal level from microphone 38 at a node 186 between 
microphone 38 and input 174 of summer 172, and con- 
trols the gain of variable gain element 180. As noted 
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above, it is desired that the training signal levels be 
maintained below a level perceptible to a person at zone 
12. 

[0044] Further in Fig. 4, the input to model 1 00 is sup- 
plied through variable training signal circuit 188 provid- 5 
ing increasing training signal levels with increasing 
speech signal levels from microphone 36. Training sig- 
nal circuit 188 includes a summer 190 having an input 
192 from microphone 36, an input 194 from a training 
signal, and an output 1 96 to loudspeaker 34 and to mod- 10 
el 100. Variable gain element 198 supplies the training 
signal from training signal source 200 to input 194 of 
summer 1 90. Voice activity detector gate 202 senses 
the speech signal level from microphone 36 at node 204 
between microphone 36 and input 1 92 of summer 190, *5 
and controls the gain of variable gain element 1 98. It is 
preferred that the training signal level be maintained be- 
low a level perceptible to a person at zone 16. 
[0045] It is desirable to detect when occupant move- 
ment or luggage loading changes occur. In one imple- 20 
mentation of the present invention, the vehicle door ajar 
or courtesy light signal may be monitored. If any door is 
opened, all on-line modeling is halted. This prohibits the 
models from adapting to both changes in the acoustic 
boundary characteristics due to open doors, and also to 2s 
changes in loudspeaker location when mounted to the 
moving door. After the doors are determined to be shut, 
and a system settling time has passed, it can be as- 
sumed that an occupant movement or luggage loading 
change is likely to have occurred. Accordingly, adapta- 30 
tion can occur to correct the acoustic echo cancellation 
models and ensure optimal performance of the system. 
Alternatively, an echo return loss enhancement meas- 
urement can be made on each model to calculate the 
echo reduction offered by each acoustic echo cancella- 3S 
tion and to determine if they are adequate. If it is deter- 
mined that they are deficient, an aggressive adaptation 
could then correct the acoustic echo cancellation mod- 
els. Again, the system enables the utilization of available 
signals to ensure system stability and robustness not *o 
only by not adapting while the physical system is in a 
nonfunctional condition but also by modeling when the 
system is returned to a functional condition to account 
for possible occupant or luggage movements. 
[0046] Digital voice enhancement systems may pick- *s 
up and rebroadcast engine related noise in vehicle ap- 
plications or other applications involving periodic or ton- 
al noise. This becomes particularly annoying when one 
of the communication zones has much lower engine re- 
lated noise than others. In this situation, the rebroadcast so 
noise is not masked by the primary engine related noise. 
In a desirable aspect of the present system, the engine 
or engine related tach signal may be conditioned with 
DC blocking and magnitude clipping to meet proper N 
D limitations. A rising edge or zero crossing detector 55 
monitors the input signal and calculates a scaler fre- 
quency value. An average magnitude detector also 
monitors the input signal to shut down the frequency de- 



tection routine if the average magnitude drops below a 
specified level. This is a noise rejection scheme for sig- 
nals with varying amplitude depending on engine speed, 
revolutions per minute, RPM. The calculated frequency 
is then converted to the engine related frequencies of 
interest which are summed and input to an electronic 
noise control, ENC, filter reference, to be described. The 
output of the filter is then subtracted from the micro- 
phone signal to remove the engine related component 
from the signal. 

[0047] In Fig. 5, atonal noise remover 210 senses pe- 
riodic noise and removes same from the output of mi- 
crophone 36 to prevent broadcast thereof by loudspeak- 
er 34. Tonal noise remover 210 includes a summer 212 
having an input 214 from microphone 36, an input 216 
from a tone generator 21 8 generating one or more tones 
in response to periodic noise and supplying same 
through adaptive filter model 220, and an output 222 to 
loudspeaker 34 through summer 90. Tone generator 
218 receives a plurality of tach signals 224, 226, and 
outputs a plurality of tone signals to summer 228 for 
each of the tach signals, for example a tone signal 1 N1 
which is the same frequency as tach signal 1 , a tone 
signal 2N1 which is twice the frequency of tach signal 
1, a tone signal 4N1 which is four times the frequency 
of tach signal 1, a tone signal 1N2 which is the same 
frequency as tach signal 2, a tone signal 2N2 which is 
twice the frequency of tach signal 2, etc. Model 220 has 
a model input 230 from summer 228, a model output 
232 outputting a correction signal to summer input 216, 
and an error input 234 from summer output 222. 
[0046] Further in Fig. 5, a second tonal noise remover 
240 senses periodic noise and removes same from the 
output of microphone 38 to prevent broadcast thereof 
by loudspeaker 32. Tonal noise remover 240 includes 
summer 242 having an input 254 from microphone 38, 
an input 246 from a tone generator 248 generating one 
more tones in response to periodic noise and supplying 
same through adaptive filter model 260, and an output 
262 to loudspeaker 32 through summer 106. Tone gen- 
erator 258 receives a plurality of tach signals such as 
264 and 266, and outputs a plurality of tone signals to 
summer 268, one for each of the tach signals, as above 
described for tone generator 218 and tach signals 224 
and 226. Model 260 has a model input 270 from summer 
268, a model output 272 outputting a correction signal 
to summer input 246, and an error input 274 from sum- 
mer output 262. In the noted vehicle implementation, 
tach 1 signals 224 and 264 are the same, and tach 2 
signals 226 and 266 are the same. 
[0049] In vehicle implementations, background ambi- 
ent noise increases with vehicle speed, and as a result 
more gain is needed in a communication system to sus- 
tain adequate speech intelligibility. In a desirable aspect, 
the present system enables application of a noise re- 
sponsive, including vehicle speed sensitive, high pass 
filter to the microphone signal. The filter cutoff would in- 
crease with elevated noise levels, such as elevated ve- 
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hide speeds, and therefor reduce the system band- 
width. By limiting system bandwidth, more gain is avail- 
able, resulting in improved speech intelligibility. At high- 
er speeds, the lower frequency speech content is 
masked by broadband vehicle and wind noise, so that $ 
the reduced bandwidth does not sacrifice the perceived 
quality of speech. At low speeds, the high pass filter low- 
ers its cutoff frequency, to provide enriched low frequen- 
cy performance, thus overcoming objections to a tinny 
sounding digital voice enhancement system. This pro- 10 
vides noise responsive, including speed dependent, 
band limiting for a communication system. 
[0050] The adaptation of the acoustic echo cancella- 
tion models with random noise may be accomplished by 
injecting the training noise before or after the noise re- '5 
sponsive or speed sensitive filter, Fig. 6. Injection before 
such filter provides a system wherein the training noise 
is speed varying filtered. This approach is advanta- 
geous in obtaining the highest training signal allowed 
while being imperceptible to the occupant. However, the 20 
acoustic echo cancellation filters would have potentially 
unconstrained frequency components. Injection after 
the speed sensitive filter provides a system wherein the 
training noise would always be full bandwidth. This has 
the potential of being more robust, yet has the limitation 25 
of lower training noise levels allowed to be imperceptible 
to the occupant. In a desirable aspect, the present sys- 
tem utilizes the natural trade-offs between bandwidth 
and gain, and results in a more robust communication 
system. 30 
[0051] In Fig. 6, a noise responsive high pass filter 
290 between microphone 36 and loudspeaker 34 has a 
filter cutoff effective at elevated noise levels and reduc- 
ing bandwidth and making more gain available, to im- 
prove intelligibility of speech of person 26 transmitted 35 
from microphone 36 to loudspeaker 34. In the noted ve- 
hicle application, high pass filter 290 is vehicle speed 
sensitive, such that at higher vehicle speeds and result- 
ing higher noise levels, lower frequency speech content 
is blocked, and higher frequency speech content is *o 
passed, the lower frequency speech content being oth- 
erwise masked at higher speeds by broadband vehicle 
and wind noise, so that the reduced bandwidth and the 
absence of the lower frequency speech content does 
not sacrifice the perceived quality of speech, and such « 
that at lower vehicle speeds and resulting lower noise 
levels, the cutoff frequency of the filter is lowered such 
that lower frequency speech content is passed, in addi- 
tion to higher frequency speech content, to provide en- 
riched low frequency performance, and overcome ob- $0 
jections to a tinny sounding system. In one embodiment, 
a summer 292 has a first input 294 from microphone 36, 
a second input 296 from a training signal supplied by 
training signal source 298, and an output 300 to high 
pass filter 290, such that the training signal is variably ss 
filtered according to noise level, namely vehicle speed 
in vehicle implementations. In an alternate embodiment, 
training signal source 298 is deleted, and a summer 302 



is provided having an input 304 from high pass filter 290, 
an input 306 from a training signal supplied by training 
signal source 308, and an output 310 to loudspeaker 34. 
In this embodiment, the training signal is full bandwidth 
and not variably filtered according to noise level or ve- 
hicle speed. 

[0052] Further in Fig. 6, a noise responsive high pass 
filter 312 between microphone 38 and loudspeaker 32 
has a filter cutoff effective at elevated noise levels and 
reducing bandwidth and making more gain available, to 
improve intelligibility of speech of person 30 transmitted 
from microphone 38 to loudspeaker 32. In the noted ve- 
hicle application, high pass filter 312 is vehicle speed 
sensitive, such that at higher vehicle speeds and result- 
ing high noise levels, lower frequency speech content 
is blocked and higher frequency speech content is 
passed, the lower frequency speech content being oth- 
erwise masked at higher speeds by broadband vehicle 
and wind noise, so that the reduced bandwidth and the 
absence of the lower frequency speech content does 
not sacrifice the perceived quality of speech, and such 
that at lower vehicle speeds and resulting lower noise 
levels, the cutoff frequency of the filter is lowered such 
that lower frequency speech content is passed, in addi- 
tion to higher frequency speech content, to provide en- 
riched low frequency performance, and overcome ob- 
jections to a tinny sounding system. In one embodiment, 
a summer 314 has a first input 316 from microphone 38, 
a second input 318 from a training signal supplied by 
training signal source 320, and an output 322 to high 
pass filter 312, such that the training signal is variably 
filtered according to noise level, namely vehicle speed 
in vehicle implementations. In an alternate embodiment, 
training signal source 320 is deleted, and a summer 324 
is provided having an input 326 from high pass filter 31 2, 
an input 328 from a training signal supplied by training 
signal source 330, and an output 332 to loudspeaker 32. 
In this embodiment, the training signal is full bandwidth 
and not variably filtered according to noise level or ve- 
hicle speed. 

[0053] Optimal voice pickup in a digital voice en- 
hancement system can be characterized by having the 
largest talking zone and the highest signal to noise ratio. 
The larger the talking zone the less sensitivity the digital 
voice enhancement system will have to the talkers phys- 
ical size, seating position, and head position/movement. 
Large talking zones are attributed with good system per- 
formance and ergonomics. High signal to noise ratios 
are associated with speech intelligibility and good sound 
quality. These two design goals are not always comple- 
mentary. Large talking zones may be accomplished by 
having multiple microphones to span the talking zone, 
however this may have a negative impact on the signal 
to noise ratio. It is desired that the available set of mi- 
crophones be scanned to determine the best candidate 
for maximum speech reception. This may be based on 
short term averages of power or magnitude. An average 
magnitude estimation and subsequent comparison from 
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two microphones is one implementation in a digital voice 
enhancement system. 

[0054] As above noted, closed loop communication 
systems can become unstable whenever the total loop 
gain exceeds unity. Careful setting of the system gain, 5 
and acoustic echo cancellation may be used to ensure 
system stability. For various reasons such as high gain 
requirements, or less than ideal acoustic echo cancel- 
lation performance, acoustic feedback can occur. 
Acoustic feedback often occurs at a system resonance 10 
or where the free response is relatively undamped. 
These resonances usually occur at a very high Q t quality 
factor, and can be represented by a narrow band in the 
frequency domain. Therefore, the total system gain ceil- 
ing is determined by only a small portion of the commu- is 
nication system bandwidth, in essence limiting perform- 
ance across all frequencies in the band for one or more 
narrow regions. In a desirable aspect, the present in- 
vention enables observation, measurement and treat- 
ment of persistent high Q system dynamics. These dy- 20 
namics may relate to acoustic instabilities to be mini- 
mized. The observation of acoustic feedback can be 
performed in the frequency domain. The nature and 
sound of acoustic feedback is commonly observed in a 
screeching or howling burst of energy. The sound quality 25 
of this type of instability is beyond reverberation, ech- 
oes, or ringing, and is observable in the frequency do- 
main by monitoring the power spectrum. Measurement 
of such a disturbance can be accomplished with a feed- 
back detector, where the exact frequency and magni- 30 
tude of the feedback can be quantified. Time domain 
based schemes such as auto correlation could alterna- 
tively be applied to obtain similar measurements. Ob- 
servation and measurement steps could be performed 
as a background task reducing real time digital signal 35 
processing requirements. Treatment follows by convert- 
ing this feedback frequency information into notch filter 
coefficients that are implemented by a filter applied to 
the communication channel. The magnitude of the re- 
duction, or depth of the notch filter's null, can be pro- *o 
gressively applied or set to maximum attenuation as de- 
sired. Once the filter has been applied, the observation 
of the acoustic feedback should vanish, however hys- 
teresis in the measurement process should be applied 
to not encourage cycling of the feedback reduction. 45 
Long term statistics of the feedback treatment process 
can be utilized for determining if the notch filter could be 
removed from the communication channel. Additionally, 
multiple notch filters may be connected in series to elim- 
inate more complicated acoustic feedback situations of- so 
ten encountered in three dimensional sound fields. 
[0055] In Fig. 7 ( feedback detector 350 has an input 
352 from microphone 36, and an output 354 controlling 
an adjustable notch fitter 356 filtering the output of mi- 
crophone 36 supplied to loudspeaker 34. Adjustable ss 
notch filter 356 has an input 358 from the output of mi- 
crophone 36. Feedback detector 350 has an input 352 
from microphone 36 at a node 360 between the output 



of microphone 36 and the input 358 of adjustable notch 
filter 356. Summer 90 has an input from the output of 
model 84, an input from the output of model 120, and 
an input from the output of adjustable notch filter 356, 
and an output supplied to loudspeaker 34. A second 
feedback detector 370 has an input 372 from micro- 
phone 38, and an output 374 controlling a second ad- 
justable notch filter 376 filtering the output of micro- 
phone 38 supplied to loudspeaker 32. Adjustable notch 
filter 376 has an input 378 from microphone 38 at a node 
380 between the output of microphone 38 and the input 
378 of adjustable notch filter 376. Summer 106 has an 
input from the output of model 100, an input from the 
output of model 1 22, and an input from the output of ad- 
justable notch filter 376. Summer 1 06has an output sup- 
plied to loudspeaker 32. 

[0056] In a further aspect, a sine wave or multiple sine 
waves can be generated from the detected feedback 
frequency and serve as the reference to the electronic 
noise control filter. The ENC filter will form notches at 
the exact frequencies, and adjust its attenuation until the 
offending feedback tones are minimized to the level of 
the noise floor. The ENC filter is similar to a classical 
adaptive interference canceler application as discussed 
in Adaptive Signal Processing, Widrow and Stearns, 
Prentice-Hall, Inc., Englewood Cliffs, NJ 07632, 1985, 
pages 31 6-323. The output of the filter is then subtracted 
from the microphone signal to remove the feedback 
component from the signal. The feedback suppression 
is performed before the acoustic echo cancellation. 
[0057] In Fig. 8, an acoustic feedback tonal canceler 
390 removes tonal feedback noise from the output of 
microphone 36 to prevent broadcast thereof by loud- 
speaker 34. Feedback tonal canceler 390 includes a 
summer 392 having an input 394 from microphone 36, 
an input 396 from feedback detector 398 and tone gen- 
erator 400 supplied through adaptive filter model 402, 
and an output 404 to loudspeaker 34 through summer 
90. Model 402 has a model input 406 from tone gener- 
ator 400, a model output 408 supplying a correction sig- 
nal to summer input 396, and an error input 410 from 
summer output 404. A second feedback tonal canceler 
420 is comparable to feedback tonal canceler 390. 
Feedback tonal canceler 420 includes a summer 422 
having an input 424 from microphone 38, an input 426 
from feedback detector 428 and tone generator 430 
supplied through adaptive filter model 432, and an out- 
put 434 supplied to loudspeaker 32 through summer 
106. Model 432 has a model input 436 from tone gen- 
erator 430, a model output 438 supplying a correction 
signal to summer input 426, and an error input 440 from 
summer output 434. 

[0058] It is desirable for communication systems to be 
usable as soon as possible after activated. However, 
this cannot take place until the acoustic echo cancella- 
tion models have converged to an accurate solution so 
that the system may be used with appropriate gain. In 
a desirable aspect, in the present system the acoustic 
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echo cancellation models may be stored in memory and 
used immediately upon system start up. These models 
may need some minor correction to account for changes 
in occupant position, luggage loading, and temperature. 
These model corrections may be accomplished with 5 
quicker adaptation from the stored models rather than 
starting from null vectors, for example in accordance 
with U.S. Patent 5,022,082, incorporated herein by ref- 
erence. 

[0059] Various equivalents, alternatives and modifi- ?o 
cations may be apparent to those skilled in the art as 
within the scope of the appended claims. 



Claims 15 

1. In a communication system comprising: 
a first acoustic zone; 

a second acoustic zone; 20 
a first microphone at said first zone; 
a first loudspeaker at said first zone; 
a second microphone at said second zone and 
having an output supplied to said first loud- 
speaker such that a first person at said first 25 
zone can hear the speech of a second person 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 
a second loudspeaker at said second zone and 
having an input supplied from said first micro- 30 
phone such that said second person at said 
second zone can hear the speech of said first 
person at said first zone as transmitted by said 
first microphone and said second loudspeaker; 
a first model canceling the speech of said sec- 35 
ond person in the output of said first micro- 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 
first loudspeaker and broadcast by said first 
loudspeaker to said first microphone, the can- 40 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 
er; 

a second model canceling the speech of said 
first person in the output of said second micro- 
phone otherwise present due to electrical trans- 
mission from said first microphone to said sec- 
ond loudspeaker and broadcast by said second 
loudspeaker to said second microphone, the so 
cancellation of the speech of said first person 
in the output of said second microphone pre- 
venting rebroadcast thereof by said first loud- 
speaker; 

the improvement comprising: ss 
a third model canceling the speech of said first 
person in the output of said first microphone 
otherwise present due to acoustic transmission 



from said second loudspeaker in said second 
zone to said first microphone in said first zone; 
a fourth model canceling the speech of said 
second person in the output of said second mi- 
crophone otherwise due to acoustic transmis- 
sion from said first loudspeaker in said first 
zone to said second microphone in said second 
zone. 

2. The invention according to claim 1 wherein: 

said first model models the path from said first 
loudspeaker to said first microphone; 
said second model models the path from said 
second loudspeaker to said second micro- 
phone; 

said third model models the path from said sec- 
ond loudspeaker to said first microphone; 
said fourth model models the path from said 
first loudspeaker to said second microphone; 
said first model has a model input from the input 
to said first loudspeaker from the output of said 
second microphone, and a mode! output to the 
output of said first microphone to the input to 
said second loudspeaker; 
said second model has a model input from the 
input to said second loudspeaker from the out- 
put of said first microphone, and a model output 
to the output of said second microphone to the 
input of said first speaker; 
said third model has a model input from the in- 
put to said second loudspeaker from the output 
of said first microphone, and a model output to 
the output of said first microphone to the input 
to said second loudspeaker; 
said fourth model has a model input from the 
input to said first loudspeaker from the output 
of said second microphone, and a model output 
to the output of said second microphone to the 
input to said first loudspeaker. 

3. The invention according to claim 1 comprising: 

a first summer summing outputs of said first and 
third models and said first microphone, and 
supplying the resultant sum to said second 
loudspeaker; 

a second summer summing outputs of said 
second and fourth models and said second mi- 
crophone, and supplying the resultant sum to 
said first loudspeaker; 

a third summer summing the output of said first 
summer and a first auxiliary noise signal, and 
supplying the resultant sum to said second 
loudspeaker; 

a fourth summer summing the output of said 
second summer and a second auxiliary noise 
signal, and supplying the resultant sum to said 
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first loudspeaker, 
and wherein: 

said first auxiliary noise signal is random and 
uncorrected relative to the speech of said first 
person; 5 
said second auxiliary noise signal is random 
and uncorrected relative to the speech of said 
second person and relative to said first auxiliary 
random noise signal; 

said first model has an error correlator having 10 
inputs from said first summer and said second 
auxiliary random noise signal; 
said second model has an error correlator hav- 
ing inputs from said second summer and said 
first auxiliary random noise signal; 
said third model has an error correlator having 
inputs from said first summer and said first aux- 
iliary random noise signal; 
said fourth model has an error correlator having 
inputs from said second summer and said sec- 20 
ond auxiliary random noise signal. 

The invention according to claim 1 comprising: 

a first summer summing outputs of said first and 2$ 
third models and said first microphone, and 
supplying the resultant sum to said second 
loudspeaker; 

a second summer summing outputs of said 
second and fourth models and said second mi- 30 
crophone, and supplying the resultant sum to 
said first loudspeaker; 
and wherein: 

said first model has a model input from the input 
to said first loudspeaker from the output of said 35 
second microphone, a model output to an input 
to said first summer, and an error input from the 
output of said first summer; 
said second model has a model input from the 
input to said second loudspeaker from the out- *o 
put of said first microphone, a model output to 
an input to said second summer, and an error 
input from the output of said second summer; 
said third model has a model input from the in- 
put to said second loudspeaker from the output 4S 
of said first summer, a model output to an input 
to said first summer, and an error input from the 
output of said first summer; 
said fourth model has a model input from the 
input to said first loudspeaker from the output so 
of said second summer, a model output to an 
input to said second summer, and an error input 
from the output of said second summer; 
and comprising: 

a third summer summing the output of said first 55 
summer and a desired audio signal for said sec- 
ond zone, and supplying the resultant sum to 
said second loudspeaker; 



a fourth summer summing the output of said 
second summer and a desired audio signal for 
said first zone, and supplying the resultant sum 
to said first loudspeaker; 
and wherein: 

said error input of said first model is supplied 
from a node between said first and third sum- 
mers; 

said error input of said second model is sup- 
plied from a node between said second and 
fourth summers; 

said error input of said third model is supplied 
from said node between said first and third 
summers; 

said error input of said fourth model is supplied 
from said node between said second and fourth 
summers; 

the model input of said first model is supplied 
from the output of said fourth summer; 
the model input of said second model is sup- 
plied from the output of said third summer; 
the model input of said third model is supplied 
from the output of said third summer; 
the model input of said fourth model is supplied 
from the output of said fourth summer. 

5. The invention according to claim 1 comprising: 

a switch having open and closed states, and 
conducting the output of one of said micro- 
phones therethrough in said closed state; 
a voice activity detector having an input from 
said output of said one microphone at a node 
between said one microphone and said switch; 
an occupant sensor sensing the presence of a 
person at one of said acoustic zones; 
an AND function having a first input from said 
voice activity detector, a second input from said 
occupant sensor, and an output to said switch 
to actuate the latter between said open and 
closed states. 

6. The invention according to claim 1 wherein: 

the input to said first model is supplied through 
a first variable training signal circuit providing 
increasing training signal levels with increasing 
speech signal levels from said second micro- 
phone, said first training signal circuit compris- 
ing a first summer having a first input from said 
second microphone, a second input from a first 
training signal, and an output to said first loud- 
speaker and to said first model, a first variable 
gain element supplying said first training signal 
to said second input of said first summer, a first 
gate sensing the speech signal level from said 
second microphone at a first node between 
said second microphone and said first input of 
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said first summer, and controlling the gain of 
said first variable gain element; 
the input to said second model is supplied 
through a second variable training signal circuit 
providing increasing training signal levels with $ 
increasing speech signal levels from said first 
microphone, said second training signal circuit 
comprising a second summer having a first in- 
put from said first microphone, a second input 
from a second training signal, and an output to io 
said second loudspeaker and to said second 
model, a second variable gain element supply- 
ing said second training signal to said second 
input of said second summer, a second gate 
sensing the speech signal level from said first '5 
microphone at a second node between said 
first microphone and said first input of said sec- 
ond summer, and controlling the gain of said 
second variable gain element. 

20 

The invention according to claim 1 comprising: 

a first tonal noise remover sensing periodic 
noise and removing same from the output of 
said first microphone to prevent broadcast 25 
thereof by said second loudspeaker, said first 
tonal noise sensor comprising a first summer 
having a first input from said first microphone, 
a second input from a first tone generator sup- 
plied through a first adaptive filter model, and 30 
an output to said second loudspeaker, said first 
tone generator generating one or more tones 
in response to periodic noise, said first adaptive 
filter model having a model input from said first 
tone generator, a model output supplying a cor- 35 
rection signal to said second input to said first 
summer, and an error input from said output of 
said first summer; 

a second tonal noise remover sensing periodic 
noise and removing same from the output of *o 
said second microphone to prevent broadcast 
thereof by said first loudspeaker, said second 
tonal noise sensor comprising a second sum- 
mer having a first input from said second micro- 
phone, a second input from a second tone gen- *s 
erator supplied through a second adaptive filter 
model, and an output to said first loudspeaker, 
said second tone generator generating one or 
more tones in response to periodic noise, said 
second adaptive filter model having a model in- so 
put from said second tone generator, a model 
output supplying a correction signal to said sec- 
ond input to said second summer, and an error 
input from said output of said second summer. 

55 

The invention according to claim 1 comprising: 
comprising a noise responsive high pass filter 



between said first microphone and said second 
loudspeaker and having a filter cutoff effective 
at elevated noise levels and reducing band- 
width and making more gain available, to im- 
prove intelligibility of speech of said first person 
transmitted from said first microphone to said 
second loudspeaker; 
and wherein: 

said system is in a vehicle, and said high pass 
filter is vehicle speed sensitive, 
such that at higher vehicle speeds and resulting 
higher noise levels, lower frequency speech 
content is blocked and higher frequency 
speech content is passed, the lower frequency 
speech content being otherwise masked at 
higher speeds by broadband vehicle and wind 
noise, so that the reduced bandwidth and the 
absence of the lower frequency speech content 
does not sacrifice the perceived quality of 
speech, 

and such that at lower vehicle speeds and re- 
sulting lower noise levels, the cutoff frequency 
of said filter is lowered such that lower frequen- 
cy speech content is passed, in addition to high- 
er frequency speech content, to provide en- 
riched low frequency performance, and over- 
come objections to a tinny sounding system. 

9. The invention according to claim 1 comprising: 

a feedback detector having an input from said 
first microphone, and an output controlling an 
adjustable notch filter filtering the output of said 
first microphone supplied to said second loud- 
speaker; 
and wherein: 

said adjustable notch fitter has an input from the 
output of said first microphone; 
said feedback detector has an input from said 
first microphone at a node between the output 
of said first microphone and the input of said 
adjustable notch filter; 

and comprising a summer summing the outputs 
of said first and third models and said adjusta- 
ble notch filter, and supplying the resultant sum 
to said second loudspeaker; 
and comprising: 

a second feedback detector having an input 
from said second microphone, and an output 
controlling a second adjustable notch filter fil- 
tering the output of said second microphone 
supplied to said first loudspeaker, said second 
adjustable notch filter having an input from the 
output of said second microphone, said second 
feedback detector having an input from said 
second microphone at a second node between 
the output of said second microphone and the 
input of said second adjustable notch filter, and 
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comprising a second summer summing the out- 
puts of said second and fourth models and said 
second adjustable notch fitter, and supplying 
the resultant sum to said first loudspeaker 

5 

10. The invention according to claim 1 comprising: 

a feedback tonal canceler removing tonal noise 
from the output of said first microphone to pre- 
vent broadcast thereof by said second loud- 10 
speaker; 
and wherein: 

said feedback tonal canceler comprises a sum- 
mer having a first input from said first micro- 
phone, a second input from a tone generator, J5 
and an output supplied to said second loud- 
speaker, and a feedback detector having an in- 
put from said first microphone, and an output 
to said tone generator; 

and comprising: 20 
a second summer summing the outputs of said 
first and third models and said first mentioned 
summer, and supplying the resultant sum to 
said second loudspeaker; 

a second feedback tonal canceler removing 25 
tonal noise from the output of said second mi- 
crophone to prevent broadcast thereof by said 
first loudspeaker, said second feedback tonal 
canceler having an input from said second mi- 
crophone, and an output summed with the out- 30 
put of said second microphone and supplied to 
said first loudspeaker, said second feedback 
tonal canceler comprising a third summer hav- 
ing a first input from said second microphone, 
a second input from a second tone generator, 35 
and an output supplied to said first loudspeak- 
er, and a second feedback detector having an 
input from said second microphone, and an out- 
put to said second tone generator, and compris- 
ing a fourth summer summing the outputs of *o 
said second and fourth models and said third 
summer, and supplying the resultant sum to 
said first loudspeaker. 

11. An active acoustic attenuation system comprising: 

a first zone subject to noise; 
a first speaking location in said first zone such 
that a first person at said first speaking location 
is subject to noise; so 
a first loudspeaker introducing sound into said 
first zone at said first speaking location; 
a first error microphone sensing noise and 
speech at said first speaking location; 
a first model having an error input from said first ss 
microphone, and an output outputting a correc- 
tion signal to said first loudspeaker to introduce 
canceling sound at said first speaking location 



to attenuate noise at said first speaking loca- 
tion; 

a second zone subject to noise; 
a second speaking location in said second zone 
such that a second person at said second 
speaking location is subject to noise; 
a second loudspeaker introducing sound into 
said second zone at said second speaking lo- 
cation; 

a second error microphone sensing noise and 
speech at said second speaking location; 
a second model having an error input from said 
second error microphone, and an output out- 
putting a correction signal to said second loud- 
speaker to introduce canceling sound at said 
second speaking location to attenuate noise at 
said second speaking location; 
a third model canceling the speech of said sec- 
ond person in the output of said first micro- 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 
first loudspeaker and broadcast by said first 
loudspeaker to said first microphone, the can- 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 
er; 

a fourth model canceling the speech of said first 
person in the output of said second microphone 
otherwise present due to electrical transmis- 
sion from said first microphone to said second 
loudspeaker and broadcast by said second 
loudspeaker to said second microphone, the 
cancellation of the speech of said first person 
in the output of said second microphone pre- 
venting rebroadcast thereof by said first loud- 
speaker; 

a fifth model canceling the speech of said first 
person in the output of said first microphone 
otherwise present due to acoustic transmission 
from said second loudspeaker in said second 
zone to said first microphone in said first zone; 
a sixth model canceling the speech of said sec- 
ond person in the output of said second micro- 
phone otherwise present due to acoustic trans- 
mission from said first loudspeaker in said first 
zone to said second microphone in said second 
zone. 

12. The invention according to claim 11 comprising: 

a seventh model having an output outputting a 
correction signal summed at a first summer with 
the output of said first microphone to electrically 
cancel noise from said first zone in the output 
of said first microphone, and having an error in- 
put from the output of said first summer; 
an eighth model having a model output output- 
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ting a correction signal summed at a second 
summer with the output of said second micro- 
phone to electrically cancel noise from said 
second zone in the output of said second mi- 
crophone, and having an error input from the s 
output of said second summer. 

13. The invention according to claim 11 comprising: 

a first summer summing the outputs of said first "> 
model and said second microphone, and sup- 
plying the resultant sum to said first loudspeak- 
er; 

a second summer summing the outputs of said 
second model and said first microphone, and '5 
supplying the resultant sum to said second 
loudspeaker; 

a third summer summing the outputs of said 
third and fifth models and said first microphone, 
and supplying the resultant sum to said second 20 
loudspeaker; 

a fourth summer summing the outputs of said 
fourth and sixth models and said second micro- 
phone, and supplying the resultant sum to said 
first loudspeaker; 25 
the output of said fourth summer being supplied 
to an input of said first summer; 
the output of said third summer being supplied 
to an input of said second summer; 
said third model having a model input from the 30 
output of said fourth summer, a model output to 
an input to said third summer, and an error input 
from the output of said third summer; 
said fourth model having a model input from the 
output of said third summer, a model output to 35 
an input to said fourth summer, and an error in- 
put from the output of said fourth summer; 
said fifth model having a model input from the 
output of said third summer, a model output to 
an input to said third summer, and an error input *o 
from the output of said third summer; 
said sixth model having a model input from the 
output of said fourth summer, a model output to 
an input to said fourth summer, and an error in- 
put from the output of said fourth summer. 4S 

14. The invention according to claim 1 3 comprising: 

a fifth summer summing the outputs of said 
third summer and a first auxiliary noise signal, so 
and supplying the resultant sum to said inputs 
to said fourth and fifth models and said second 
summer; 

a sixth summer summing the outputs of said 
fourth summer and a second auxiliary noise 55 
signal, and supplying the resultant sum to said 
inputs to said third and sixth models and said 
first summer; 



and wherein: 

said first auxiliary noise signal is random and 
uncorrelated relative to said noise in said first 
zone, the speech of said first person, said noise 
in said second zone, and the speech of said 
second person; 

said second auxiliary noise signal is random 
and uncorrelated relative to said noise in said 
first zone, the speech of said first person, said 
noise in said second zone, the speech of said 
second person, and said first random auxiliary 
noise signal; 

said third model has an error correlator having 
inputs from said third summer and said second 
random auxiliary noise signal; 
said fourth model has an error correlator having 
inputs from said fourth summer and said first 
random auxiliary noise signal; 
said fifth model has an error correlator having 
inputs from said third summer and said first ran- 
dom auxiliary noise signal; 
said sixth model has an error correlator having 
inputs from said fourth summer and said sec- 
ond random auxiliary noise signal. 

15. A communication system comprising: 

a first acoustic zone; 
a second acoustic zone; 
a first microphone at said first zone; 
a first loudspeaker at said first zone; 
a second microphone at said second zone and 
having an output supplied to said first loud- 
speaker such that a first person at said first 
zone can hear the speech of a second person 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 
a second loudspeaker at said second zone and 
having an input supplied from said first micro- 
phone such that said second person at said 
second zone can hear the speech of said first 
person at said first zone as transmitted by said 
first microphone and said second loudspeaker; 
a switch having open and closed states, and 
conducting the output of one of said micro- 
phones therethrough in said closed state; 
a voice activity detector having an input from 
said output of said one microphone at a node 
between said one microphone and said switch; 
an occupant sensor sensing the presence of a 
person at one of said acoustic zones; 
an AND function having a first input from said 
voice activity detector, a second input from said 
occupant sensor, and an output to said switch 
to actuate the latter between said open and 
closed states. 

16. A communication system comprising: 
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a first acoustic zone; 
a second acoustic zone; 
a first microphone at said first zone; 
a first loudspeaker at said first zone; 
a second microphone at said second zone and $ 
having an output supplied to said first loud- 
speaker such that a first person at said first 
zone can hear the speech of a second person 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 10 
a second loudspeaker at said second zone and 
having an input supplied from said first micro- 
phone such that said second person at said 
second zone can hear the speech of said first 
person at said first zone as transmitted by said '5 
first microphone and said second loudspeaker; 
a first model canceling the speech of said sec- 
ond person in the output of said first micro- 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 20 
first loudspeaker and broadcast by said first 
loudspeaker to said first microphone, the can- 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 25 
er; 

a second model canceling the speech of said 
first person in the output of said second micro- 
phone otherwise present due to electrical trans- 
mission from said first microphone to said sec- 30 
ond loudspeaker and broadcast by said second 
loudspeaker to said second microphone, the 
cancellation of the speech of said first person 
in the output of said second microphone pre- 
venting rebroadcast thereof by said first loud- 35 
speaker; 

a variable training signal circuit supplying an in- 
put to said first model and providing increasing 
training signal levels with increasing speech 
signal levels from said second microphone. 40 

17. The invention according to claim 16 wherein said 
training signal circuit comprises: 

a summer having a first input from said second 45 
microphone, a second input from said training 
signal, and an output to said first loudspeaker 
and to said first model; 

a variable gain element supplying said training 
signal to said second input of said summer; so 
a gate sensing the speech signal level from said 
second microphone at a node between said 
second microphone and said first input of said 
summer, and controlling the gain of said varia- 
ble gain element; 55 
and comprising: 

a second variable training signal circuit supply- 
ing an input to said second model and providing 



increasing training signal levels with increasing 
speech levels from said first microphone, said 
second training signal circuit comprising a sec- 
ond summer having a first input from said first 
microphone, a second input from a second 
training signal, and an output to said second 
loudspeaker and to said second model, a sec- 
ond variable gain element supplying said sec- 
ond training signal to said second input of said 
second summer, a second gate sensing the 
speech level from said first microphone at a 
second node between said first microphone 
and said first input of said second summer, and 
controlling the gain of said second variable gain 
element, wherein said training signal circuits 
maintain training signal levels of said training 
signals below levels perceptible to persons at 
said first and second zones. 

18. A communication system comprising; 

a first acoustic zone; 
a second acoustic zone; 
a first microphone at said first zone; 
a first loudspeaker at said first zone; 
a second microphone at said second zone and 
having an output supplied to said first loud- 
speaker such that a first person at said first 
zone can hear the speech of a second person 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 
a second loudspeaker at said second zone and 
having an input supplied from said first micro- 
phone such that said second person at said 
second zone can hear the speech of said first 
person at said first zone as transmitted by said 
first microphone and said second loudspeaker; 
a first model canceling the speech of said sec- 
ond person in the output of said first micro- 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 
first loudspeaker and broadcast by said first 
loudspeaker to said first microphone, the can- 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 
er; 

a second model canceling the speech of said 
first person in the output of said second micro- 
phone otherwise present due to electrical trans- 
mission from said first microphone to said sec- 
ond loudspeaker and broadcast by said second 
loudspeaker to said second microphone, the 
cancellation of the speech of said first person 
in the output of said second microphone pre- 
venting rebroadcast thereof by said first loud- 
speaker; 

a summer having a first input from said first mi- 



16 



31 



EP 0 903 726 A2 



32 



crophone, a second input from a tone generator 
generating one or more tones in response to 
periodic noise, and an output to said second 
loudspeaker. 

5 

19. The invention according to claim 18 comprising in 
combination: 

a first tonal noise remover sensing periodic 
noise and removing same from the output of io 
said first microphone to prevent broadcast 
thereof by said second loudspeaker, said first 
tonal noise remover comprising said summer 
having said first input from said first micro- 
phone, said second input from said tone gen- is 
erator supplied through said adaptive filter 
model, and said output to said second loud- 
speaker; 

a second tonal noise remover sensing periodic 
noise and removing same from the output of 20 
said second microphone to prevent broadcast 
thereof by said first loudspeaker, said second 
tonal noise remover comprising a second sum- 
mer having a first input from said second micro- 
phone, a second input from a second tone gen- 2S 
erator supplied through a second adaptive filter 
model, and an output to said first loudspeaker, 
said second tone generator generating one or 
more tones in response to periodic noise, said 
second adaptive filter model having a model in- 30 
put from said second tone generator, a model 
output supplying a correction signal to said sec- 
ond input to said second summer, and an error 
input from said output of said second summer. 

35 

20. A communication system comprising: 

a first acoustic zone; 
a second acoustic zone; 

a first microphone at said first zone; 40 
a first loudspeaker at said first zone; 
a second microphone at said second zone and 
having an output supplied to said first loud- 
speaker such that a first person at said first 
zone can hear the speech of a second person <s 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 
a second loudspeaker at said second zone and 
having an input supplied from said first micro- 
phone such that said second person at said so 
second zone can hear the speech of said first 
person at said first zone as transmitted by said 
first microphone and said second loudspeaker; 
a first model canceling the speech of said sec- 
ond person in the output of said first micro- ss 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 
first loudspeaker and broadcast by said first 



loudspeaker to said first microphone, the can- 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 
er; 

a second model canceling the speech of said 
first person in the output of said second micro- 
phone otherwise present due to electrical trans- 
mission from said first microphone to said sec- 
ond loudspeaker and broadcast by said second 
loudspeaker to said second microphone, the 
cancellation of the speech of said first person 
in the output of said second microphone pre- 
venting rebroadcast thereof by said first loud- 
speaker; 

a noise responsive high pass filter between 
said first microphone and said second loud- 
speaker and having a filter cutoff effective at el- 
evated noise levels and reducing bandwidth 
and making more gain available, to improve in- 
telligibility of speech of said first person trans- 
mitted from said first microphone to said sec- 
ond loudspeaker. 

21 . The invention according to claim 20 wherein said 
system is in a vehicle, and said high pass filter is 
vehicle speed sensitive, 

such that at higher vehicle speeds and resulting 
higher noise levels, lower frequency speech 
content is blocked and higher frequency 
speech content is passed, the lower frequency 
speech content being otherwise masked at 
higher speeds by broadband vehicle and wind 
noise, so that the reduced bandwidth and the 
absence of the lower frequency speech content 
does not sacrifice the perceived quality of 
speech, 

and such that at tower vehicle speeds and re- 
sulting lower noise levels, the cutoff frequency 
of said filter is lowered such that lower frequen- 
cy speech content is passed, in addition to high- 
er frequency speech content, to provide en- 
riched low frequency performance, and over- 
come objections to a tinny sounding system. 

22. The invention according to claim 20 comprising: 

a second noise responsive high pass filter be- 
tween said second microphone and said first 
loudspeaker and having a filter cutoff effective 
at elevated noise levels and reducing band- 
width and making more gain available, to im- 
prove intelligibility of speech of said second 
person transmitted from said second micro- 
phone to said first loudspeaker, 
a first summer summing the outputs of said first 
model and said first mentioned noise respon- 
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sive high pass fitter, and supplying the resultant 
sum to said second loudspeaker; 
a second summer summing the outputs of said 
second model and said second noise respon- 
sive high pass fitter, and supplying the resultant 5 
sum to said first loudspeaker. 

23. A communication system comprising: 

a first acoustic zone; ?o 
a second acoustic zone; 
a first microphone at said first zone; 
a first loudspeaker at said first zone; 
a second microphone at said second zone and 
having an output supplied to said first loud- is 
speaker such that a first person at said first 
zone can hear the speech of a second person 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 
a second loudspeaker at said second zone and 20 
having an input supplied from said first micro- 
phone such that said second person at said 
second zone can hear the speech of said first 
person at said first zone as transmitted by said 
first microphone and said second loudspeaker; 25 
a first model canceling the speech of said sec- 
ond person in the output of said first micro- 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 
first loudspeaker and broadcast by said first 30 
loudspeaker to said first microphone, the can- 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 
er; 35 
a second model canceling the speech of said 
first person in the output of said second micro- 
phone otherwise present due to electrical trans- 
mission from said first microphone to said sec- 
ond loudspeaker and broadcast by said second *o 
loudspeaker to said second microphone, the 
cancellation of the speech of said first person 
in the output of said second microphone pre- 
venting rebroadcast thereof by said first loud- 
speaker; 45 
a feedback detector having an input from said 
first microphone, and an output controlling an 
adjustable notch filter filtering the output of said 
first microphone supplied to said second loud- 
speaker. 50 

24. The invention according to claim 23 wherein: 

said adjustable notch filter has an input from the 
output of said first microphone; 55 
said feedback detector has an input from said 
first microphone at a node between the output 
of said first microphone and the input of said 



adjustable notch filter, 

and comprising a summer having a first input 
from the output of said first model, and a second 
input from the output of said adjustable notch 
filter, and an output supplied to said second 
loudspeaker; 

and comprising a second feedback detector 
having an input from said second microphone, 
and an output controlling a second adjustable 
notch filter filtering the output of said second mi- 
crophone supplied to said first loudspeaker, 
said second adjustable notch filter having an in- 
put from the output of said second microphone, 
said second feedback detector having an input 
from said second microphone at a second node 
between the output of said second microphone 
and the input of said second adjustable notch 
filter, and comprising a second summer having 
a first input from the output of said second mod- 
el, a second input from the output of said sec- 
ond adjustable notch filter, and an output sup- 
plied to said first loudspeaker. 

25. A communication system comprising: 

a first acoustic zone; 
a second acoustic zone; 
a first microphone at said first zone; 
a first loudspeaker at said first zone; 
a second microphone at said second zone and 
having an output supplied to said first loud- 
speaker such that a first person at said first 
zone can hear the speech of a second person 
at said second zone as transmitted by said sec- 
ond microphone and said first loudspeaker; 
a second loudspeaker at said second zone and 
having an input supplied from said first micro- 
phone such that said second person at said 
second zone can hear the speech of said first 
person at said first zone as transmitted by said 
first microphone and said second loudspeaker; 
a first model canceling the speech of said sec- 
ond person in the output of said first micro- 
phone otherwise present due to electrical trans- 
mission from said second microphone to said 
first loudspeaker and broadcast by said first 
loudspeaker to said first microphone, the can- 
cellation of the speech of said second person 
in the output of said first microphone preventing 
rebroadcast thereof by said second loudspeak- 
er; 

a second model canceling the speech of said 
first person in the output of said second micro- 
phone otherwise present due to electrical trans- 
mission from said first microphone to said sec- 
ond loudspeaker and broadcast by said second 
loudspeaker to said second microphone, the 
cancellation of the speech of said first person 
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in the output of said second microphone pre- 
venting re broadcast thereof by said first loud- 
speaker; 

a feedback tonal canceler removing tonal noise 
from the output of said first microphone to pre- 
vent broadcast thereof by said second loud- 
speaker. 

26. The invention according to claim 25 wherein said 
feedback tonal canceler has an input from said first 
microphone, and an output summed with the output 
of said first microphone and supplied to said second 
loudspeaker; 

wherein said feedback tonal canceler compris- 
es a summer having a first input from said first 
microphone, a second input from a tone gener- 
ator, and an output supplied to said second 
loudspeaker, and a feedback detector having 
an input from said first microphone, and an out- 
put to said tone generator; 
and comprising a second summer having a first 
input from the output of said first model, a sec- 
ond input from the output of said first summer, 
and an output supplied to said second loud- 
speaker; 

a second feedback tonal canceler removing 
tonal noise from the output of said second mi- 
crophone to prevent broadcast thereof by said 
first loudspeaker, said second feedback tonal 
canceler having an input from said second mi- 
crophone, and an output summed with the out- 
put of said second microphone and supplied to 
said first loudspeaker, said second feedback 
tonal canceler comprising a third summer hav- 
ing a first input from said second microphone, 
a second input from a second tone generator, 
and an output supplied to said first loudspeak- 
er, and a second feedback detector having an 
input from said second microphone, and an out- 
put to said second tone generator, and compris- 
ing a fourth summer having a first input from 
the output of said second model, a second input 
from the output of said third summer, and an 
output supplied to said first loudspeaker; 
and wherein the output of said second tone 
generator is supplied through a second adapz- 
tive filter model to said second input to said third 
summer, said second adaptive filter model hav- 
ing a model input from said second tone gen- 
erator, a model output supplying a correction 
signal to said second input to said third sum- 
mer, and an error input from said output of said 
third summer. 

27. A communication system comprising first and sec- 
ond acoustic zones, a microphone at said first zone, 
a loudspeaker at said second zone and having an 



input supplied from said microphone such that a 
person at said second zone can hear the speech of 
a person at said first zone, a switch having open 
and closed states and conducting the output of said 

s microphone therethrough in said closed state, a 
voice activity detector having an input from said out- 
put of said microphone at a node between said mi- 
crophone and said switch, an occupant sensor 
sensing the presence of a person at said first zone, 

10 an AND function having a first input from said voice 
activity detector, a second input from said occupant 
sensor, and an output to said switch to actuate the 
latter between said open and closed states. 

15 28. A communication system comprising first and sec- 
ond acoustic zones, a microphone at said first zone, 
a loudspeaker at said second zone and having an 
input supplied from said microphone such that a 
person at said second zone can hear the speech of 
20 a person at said first zone, a tonal noise remover 
sensing periodic noise and removing same from the 
output of said microphone to prevent broadcast 
thereof by said loudspeaker. 

2S 29. The invention according to claim 28 wherein said 
tonal noise remover comprises a summer having a 
first input from said microphone, a second input 
from a tone generator generating one or more tones 
in response to said periodic noise, and an output to 
30 said loudspeaker; 

wherein the output of said tone generator is 
supplied through an adaptive filter model to 
said summer; 

35 wherein said adaptive filter model has a model 

input from said tone generator, a model output 
supplying a correction signal to said second in- 
put to said summer, and an error input from said 
output of said summer. 

40 

30. A communication system comprising first and sec- 
ond acoustic zones, a microphone at said first zone, 
a loudspeaker at said second zone and having an 
input supplied from said microphone such that a 

45 person at said second zone can hear the speech of 
a person at said first zone, a noise responsive high- 

pass filter between said microphone and said loud- 
speaker and having a filter cutoff effective at elevat- 
ed noise levels and reducing bandwidth and making 

so more gain available, to improve intelligibility of 
speech of said person at said first zone transmitted 
from said microphone to said loudspeaker. 

31. A communication system comprising first and sec- 
55 ond acoustic zones, a microphone at said first zone, 

a loudspeaker at said second zone and having an 
input supplied from said microphone such that a 
person at said second zone can hear the speech of 
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a person at said first zone, a switch having open 
and closed states and conducting the output of said 
microphone therethrough in said closed state, a 
voice activity detector having an input from said out- 
put of said microphone at a node between said mi- s 
crophone and said switch, a noise responsive high- 
pass filter between said microphone and said loud- 
speaker and having a filter cutoff effective at elevat- 
ed noise levels and reducing bandwidth and making 
more gain available, to improve intelligibility of 10 
speech of said person at said first zone transmitted 
from said microphone to said loudspeaker when 
said switch is in said closed state. 

32. A vehicle communication system comprising first 
and second acoustic zones in the vehicle, a first mi- 
crophone at said first zone, a loudspeaker at said 
second zone and having an input supplied from said 
microphone such that an occupant at said second 
zone can hear the speech of an occupant at said 20 
first zone, a vehicle speed sensitive highpass filter 
between said microphone and said loudspeaker 
and having a filter cutoff effective at elevated vehicle 
speeds and reducing bandwidth and making more 
gain available, to improve intelligibility of speech of 2s 
said occupant at said first zone transmitted from 
said microphone to said loudspeaker, such that at 
higher vehicle speeds, lower frequency speech 
content is blocked and higher frequency speech 
content is passed, the lower frequency speech con- -30 
tent being otherwise masked at higher speeds by 
broadband vehicle and wind noise, so that the re- 
duced bandwidth and the absence of the lower fre- 
quency speech content does not sacrifice the per- 
ceived quality of speech, and such that at lower ve- 35 
hide speeds, the cutoff frequency of said filter is 
lowered such that lower frequency speech content 
is passed, in addition to higher frequency speech 
content, to provide enriched low frequency perform- 
ance, and overcome objections to a tinny sounding *o 
system in said vehicle. 
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